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DETAILED ACTION 

Claim Objections 

1. Claims 6, 8, 16, 18 are objected to because of the following informalities: Claims 6, 8, 
16 and 18 recite "planar region grouping means/step" however the independent claims 1 and 12 
of which they depend, respectively recite "planar region growing means/step". Appropriate 
correction is required. 

Claim Rejections - 35 USC § 101 

2. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or 
any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and 
requirements of this title. 

3. Claims 12-18 are rejected under 35 U.S.C. 101 as not falling within one of the four 
statutory categories of invention. While the claims recite a series of steps or acts to be performed, 
a statutory "process" under 35 U.S.C. 101 must (1) be tied to another statutory category (such as 
a particular apparatus), or (2) transform underlying subject matter (such as an article or material) 
to a different state or thing. The instant claims neither transform underlying subject matter nor 
positively tie to another statutory category that accomplishes the claimed method steps, and 
therefore do not qualify as a statutory process. For example in claim 12, the step of: a line fitting 
step of fitting a line to each group of distance data points estimated to be in one plane in a three- 
dimensional space could be performed by a person using paper and pencil; a similar argument 
could be made for the remaining steps of claim 12, thus the steps of claim 12 are not inherently 
performed by an apparatus; similar arguments could be made for claims 13-18. 
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Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

5. Claims 1-19 are rejected under 35 U.S.C. 103(a) as being unpatentable over Kanade et al. 
Pub. No.: US 2005/0135680 Al in view of Leger Patent No.: 5,978,504. 

6. Regarding claim 1, Kanade teaches: A plane detection apparatus for detecting planes 
from three-dimensional distance data, the apparatus comprising: a line fitting means for fitting a 
line to each group of distance data points estimated to be in one plane in a three-dimensional 
space (figs. 16-18 see also [0083] [0084]); the line fitting means fitting lines adaptively to the 
distribution of distance data points (fig. 18, 94 see also [0084]) (The lines of staircase model are 
adaptively fit to the data points). 

7. Kanade doesn't teach: a planar region growing means for extracting a plurality of lines 
estimated to be in one plane from a group of lines extracted by the line fitting means to calculate 
a plane from the plurality of lines 

8. The analogous prior art Leger teaches: a planar region growing means for extracting a 
plurality of lines estimated to be in one plane from a group of lines extracted by the line fitting 
means to calculate a plane from the plurality of lines (fig. 1, 24 see also col. 3 lines 43-46) for 
the benefit of providing a method of extracting planar features from three-dimensional image 
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data in a noisy environment, such as a platform which moves during data acquisition (col. 1 lines 
42-45). 

9. It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine a planar region growing means for extracting a plurality of lines estimated 
to be in one plane from a group of lines extracted by the line fitting means to calculate a plane 
from the plurality of lines as shown in Leger with Kanade for the benefit of providing a method 
of extracting planar features from three-dimensional image data in a noisy environment, such as 
a platform which moves during data acquisition. 

10. Regarding claim 2, Kanade teaches: The apparatus, wherein the line fitting means 
extracts a group of distance data points estimated to be in one plane on the basis of the distance 
between the distance data points, and re-estimates, based on the distribution of the distance data 
points in the distance data point group, whether the distance data point group exists in one plane 
(fig. 14, 90 see also [0089]). 

1 1 . Regarding claim 3, Kanade teaches: The apparatus, wherein the line fitting means 
extracts lines from a group of distance data points estimated to be in the one plane, takes, as a 
point of interest, a distance data point whose distance to the lines is largest in the group of 
distance data points, judges, when the distance is smaller than a predetermined threshold, 
whether the distance data points in the distance data point group are unevenly distributed, and 
segments the distance data point group by the point of interest when the distribution is uneven 
(fig. 9, 90 see also [0072]). 

12. Regarding claim 4, Kanade teaches: The apparatus, wherein the line fitting means 
extracts a first line from the group of distance data points estimated to lie in the one plane, takes 
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a distance data point in the group, whose distance from the first line is longest, as a point of 
interest, extracts a second line from the distance data point group when the distance is smaller 
than a predetermined threshold, judges whether a larger number of distance data points than a 
predetermined number exist continuously at one side of the second line, and divides the distance 
data point group by the point of interest when a larger number of distance data points than the 
predetermined number exist continuously (fig. 1 1, see also [0072]). 

13. Regarding claim 6, Leger further teaches: The apparatus, wherein the planar region 
grouping means selects more than one line estimated to be in one plane and calculates a 
reference plane, searches lines estimated to be in the plane in which the reference plane lies as 
grouping lines from the group of lines, updates the reference plane with the grouping lines, 
repeats the grouping of the region of the reference plane, and outputs the updated plane as an 
updated one (col. 5 lines 10-14). 

14. Regarding claim 7, Leger further teaches: The apparatus, further comprising a plane 
recalculating means for recalculating a plane from the group of distance data points except for 
ones whose distance from the updated plane is larger than a predetermined threshold, if any, 
existing in the distance data point group in the updated plane (col. 5 lines 14-19). 

15. Regarding claim 8, Leger further teaches: The apparatus, wherein the planar region 
grouping means estimates, based on a difference between a lines-determined plane and reference 
plane, whether the lines lie coplanar with the reference plane (col. 6 lines 21-25). 

16. Regarding claim 9, Kanade teaches: The apparatus, wherein the line fitting means 
generates the second line by the least-squares method from a group of distance data points 
estimated to be in the one plane (fig. 18, 94 see also [0084]). 



Application/Control Number: 10/593,150 Page 6 

Art Unit: 2628 

17. Regarding claim 10, Kanade teaches: The apparatus, wherein the line fitting means 
extracts lines on the basis of three-dimensional distance data measured by a distance measuring 
means which measures a distance on the basis of a parallax of two imaging means (fig. 4, 50 see 
also [0096]). 

18. Regarding claim 11, Leger further teaches: The apparatus, wherein the line fitting means 
extracts lines on the basis of three-dimensional distance data measured by a laser range finder 
(col. 1 lines 62-65). 

19. Regarding claim 12, Kanade teaches: A plane detection method of detecting planes from 
three-dimensional distance data, the method comprising: a line fitting step of fitting a line to each 
group of distance data points estimated to be in one plane in a three-dimensional space (figs. 16- 
18 see also [0083] [0084]); in the line fitting step, lines being fitted adaptively to the distribution 
of distance data points (fig. 18, 94 see also [0084]). 

20. Kanade doesn't teach: a planar region growing step of extracting a plurality of lines 
estimated to be in one plane from a group of lines extracted by the line fitting means to calculate 
a plane from the plurality of lines. 

21 . The analogous prior art Leger teaches: a planar region growing step of extracting a 
plurality of lines estimated to be in one plane from a group of lines extracted by the line fitting 
means to calculate a plane from the plurality of lines (fig. 1, 24 see also col. 3 lines 43-46) for 
the benefit of providing a method of extracting planar features from three-dimensional image 
data in a noisy environment, such as a platform which moves during data acquisition. 

22. It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine a planar region growing step of extracting a plurality of lines estimated to 
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be in one plane from a group of lines extracted by the line fitting means to calculate a plane from 
the plurality of lines as shown in Leger with Kanade for the benefit of providing a method of 
extracting planar features from three-dimensional image data in a noisy environment, such as a 
platform which moves during data acquisition. 

23. Regarding claim 13, Kanade teaches: The method, wherein in the line fitting step, there is 
extracted a group of distance data points estimated to be in one plane on the basis of the distance 
between the distance data points, and it is re-estimated, based on the distribution of the distance 
data points in the distance data point group, whether the distance data point group exists in one 
plane (fig. 14, 90 see also [0089]). 

24. Regarding claim 14, Kanade teaches: The method, wherein in the line fitting step, there 
are extracted lines from a group of distance data points estimated to be in the one plane, takes, as 
a point of interest, a distance data point whose distance to the lines is largest in the group of 
distance data points, it is judged, when the distance is smaller than a predetermined threshold, 
whether the distance data points in the distance data point group are unevenly distributed, and the 
distance data point group is segmented by the point of interest when the distribution is uneven 
(fig. 9, 90 see also [0072]). 

25. Regarding claim 15, Kanade teaches: The method, wherein in the line fitting step, there is 
extracted a first line from the group of distance data points estimated to lie in the one plane, a 
distance data point in the group, whose distance from the first line is longest, is taken as a point 
of interest, there is extracted a second line from the distance data point group when the distance 
is smaller than a predetermined threshold, it is judged whether a larger number of distance data 
points than a predetermined number exist continuously at one side of the second line, and the 
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distance data point group is segmented by the point of interest when the larger number of 
distance data points than the predetermined number exist continuously (fig. 11, see also [0072]). 

26. Regarding claim 16, Leger further teaches: The method, wherein in the planar region 
grouping step, there are selected more than one line estimated to be in one plane and a reference 
plane is calculated, there are searched lines estimated to be in the plane in which the reference 
plane lies as grouping lines from the group of lines, the reference plane with the grouping lines is 
updated and the grouping of the region of the reference plane is repeated, and the updated plane 
is outputted as an updated one (col. 5 lines 10-14). 

27. Regarding claim 17, Leger further teaches: The method, further comprising a plane 
recalculating step of recalculating a plane from the group of distance data points except for ones 
whose distance from the updated plane is larger than a predetermined threshold, if any, existing 
in the distance data point group in the updated plane (col. 5 lines 14-19). 

28. Regarding claim 18, Leger further teaches: The method, wherein in the planar region 
grouping step, it is estimated, based on a difference between a lines-determined plane and 
reference plane, whether the lines lie coplanar with the reference plane (col. 6 lines 21-25). 

29. Regarding claim 19, Kanade teaches: An autonomous locomotion robot apparatus, 
comprising: a distance measuring means for acquiring three-dimensional distance data (fig. 5, 
812 see also [0069]); a plane detection apparatus for detecting a plane from the three- 
dimensional distance data (fig. 5, 810 see also [0067]); and a motion controlling means for 
controlling the motion of the apparatus on the basis of the result of plane detection by the plane 
detection apparatus (fig. 3, 60 see also [0057]), the plane detection apparatus including: a line 
fitting means for fitting a line to each group of distance data points estimated to be in one plane 
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in a three-dimensional space (figs. 16-18 see also [0083] [0084]); the line fitting means fitting 
lines adaptively to the distribution of distance data points (fig. 18, 94 see also [0084]). 

30. Kanade doesn't teach: a planar region growing means for extracting a plurality of lines 
estimated to be in one plane from a group of lines extracted by the line fitting means to calculate 
a plane from the plurality of lines. 

3 1 . The analogous prior art Leger teaches: a planar region growing means for extracting a 
plurality of lines estimated to be in one plane from a group of lines extracted by the line fitting 
means to calculate a plane from the plurality of lines (fig. 1, 24 see also col. 3 lines 43-46) for 
the benefit of providing a method of extracting planar features from three-dimensional image 
data in a noisy environment, such as a platform which moves during data acquisition. 

32. It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine a planar region growing means for extracting a plurality of lines estimated 
to be in one plane from a group of lines extracted by the line fitting means to calculate a plane 
from the plurality of lines as shown in Leger with Kanade for the benefit of providing a method 
of extracting planar features from three-dimensional image data in a noisy environment, such as 
a platform which moves during data acquisition. 

33. Claim 5 is rejected under 35 U.S.C. 103(a) as being unpatentable over Kanade et al. Pub. 
No.: US 2005/0135680 Al in view of Leger Patent No.: 5,978,504 further in view of Mitaka et 
al. Patent No.: 5,546,476. 

34. Regarding claim 5, the previous combination of Kanade and Leger remains as above but 
doesn't teach: The apparatus, wherein the line fitting means segments the distance data point 
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group when the standard deviation of the distance data point group from which the first line has 
been determined is larger than a predetermined threshold. 

35. The analogous prior art Mitaka teaches: The apparatus, wherein the line fitting means 
segments the distance data point group when the standard deviation of the distance data point 
group from which the first line has been determined is larger than a predetermined threshold (fig. 
2 see also col. 14 lines 10-20) for the benefit of providing a shape recognition process in which 
the collation can be performed without changing the shape model even in an event where inputs 
of the objective shape are successively provided over time and the objective shape involves a 
significant fluctuation in respective objects (col. 2 lines 1-9). 

36. It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine the apparatus, wherein the line fitting means segments the distance data 
point group when the standard deviation of the distance data point group from which the first line 
has been determined is larger than a predetermined threshold as shown in Mitaka with the 
previous combination for the benefit of providing a shape recognition process in which the 
collation can be performed without changing the shape model even in an event where inputs of 
the objective shape are successively provided over time and the objective shape involves a 
significant fluctuation in respective objects. 

37. Claims 20-21 are rejected under 35 U.S.C. 103(a) as being unpatentable over Kanade et 
al. Pub. No.: US 2005/0135680 Al in view of Leger Patent No.: 5,978,504 further in view of 
Lewis Pub. No.: US 2004/0138780 Al. 
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38. Regarding claim 20, the previous combination of Kanade and Leger remains as above but 
doesn't teach: The apparatus, further comprising a texture imparting means for imparting a 
texture to an object. 

39. The analogous prior art Lewis teaches: The apparatus, further comprising a texture 
imparting means for imparting a texture to an object (fig. 10, 49 see also [0066]) for the benefit 
of to provide a robot that has the ability to detect non-geometric stimuli, such as color, texture, or 
other surface attributes and determine the utility functions resulting from such stimuli [0018]. 

40. It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine the apparatus, further comprising a texture imparting means for imparting 
a texture to an object as shown in Lewis with the previous combination for the benefit of to 
provide a robot that has the ability to detect non-geometric stimuli, such as color, texture, or 
other surface attributes and determine the utility functions resulting from such stimuli. 

4 1 . Regarding claim 2 1 , Lewis further teaches: The apparatus, wherein the texture imparting 
means projects a texture to the object when acquiring the three-dimensional distance data (fig. 
10, 47 see also [0066]). 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to MAURICE MCDOWELL, JR whose telephone number is 
(571)270-3707. The examiner can normally be reached on Mon-Friday 7:30am - 5:00pm 
Eastern Time. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Xiao Wu can be reached on 571—272-7761. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

MM 



/XIAO M. WU/ 

Supervisory Patent Examiner, Art Unit 2628 



